Enhancing Touch and Feel on the Internet

ABSTRACT

A system for enabling touch and feel over the internet provides a three-dimensional representation of a good being sold, that three-dimensional representation being viewable from a number of different directions. In one embodiment, the good being sold is in a package and the package is displayed from the number of different directions. Another embodiment has the good being a book, and the inside and outside covers of the book are displayed and specified pages of the book can be displayed. The user can read from either the label or the covers just like as if the were actually handling the good.

This application claims priority from Provisional Application Ser. No.60/155,543, filed on Sep. 22, 1999.

The present application relates to improvements in the user interfacethat enables enhancing simulation of real touch and feel over a remoteinformation server.

More specifically, the present application describes enhancing therealism of product descriptions over the Internet, to make Internetshopping more like real life shopping.

BACKGROUND

Shopping over the Internet has become very popular. A primary reason isconvenience. A user can sit at their computer and shop from a number ofdifferent Internet web sites. Without physically moving, the user canselect from different items in different sites. The prices are oftenlower than, or at least comparable to, what one would pay in retailstores. The shopping is very convenient.

Internet browsing provides a limited amount of information about theproduct. In a store, if a user wants to select between multiple items,the user consults the packaging that accompanies the product. They canread the packages, look at information on the package, and touch thepackage. The packaging often sells the product. Large amounts of moneyare spent on packaging for the products.

Internet web pages often reflect minimal information about the productpackaging. Hence, shopping on the Internet is most effective when theuser already knows what they want.

Software such as Apple Quicktime VR™ allows some limited pseudothree-dimensional viewing.

SUMMARY

The present application teaches a new paradigm of selling over theInternet.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other aspects will now be described in detail with referenceto the accompanying drawings, wherein:

FIG. 1A shows a screen shot of an exemplary web page for selling aproduct;

FIGS. 1B and 1C show views of the simulated 3D product, respectivelyfrom the front and the rear;

FIG. 1D shows an image formed of varying resolution portions;

FIG. 2 shows a flowchart of operation of the first embodiment;

FIGS. 3A and 3B show different vantage points used to view an object toenable simulated three dimensional view;

FIG. 3C shows a flowchart of operation with these simulated viewpoints;

FIGS. 4A and 4B show a book display embodiment, showing the book fromfront and rear respectively;

FIG. 4C shows the inside of the book; and

FIG. 5 shows a flowchart of operation of this embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENT

According to the present application, a user interface is describedwhich provides the same information to a user that could be provided ifthe user could physically pick up and handle the product.

According to one aspect of the present application, the entire productpackage is rendered in three dimensions. The rendering includes theshape and color of the product from at least a plurality of differentangles, and specifically from at least enough angles to enable readingeach label on the package. The user interface includes controls thatenable moving the product within the user interface, in a way thatenables viewing from each of these different angles.

One special application of this system is for use in books, music andvideos. Bookstores are used by people who browse through the bookselection, reading pages, looking at pictures, and trying to get thefeel of the different books. The present system teaches an interface tothe book contents that enables viewing the outside portion of the book,specified pages of the book, and leafing through random pages of thebook. An embodiment limits the amount of reading that the user can do,to prevent the entire book from simply being read on line.

Another aspect of the above applies the same kind of operation to videosand music. The liner notes can be perused. and the packaging of thevideo/music element can be viewed from different angles.

According to one aspect of this system, a special extension to hypertextmarkup language is defined. A hypertext mark up languageextension/object is defined which can be hold the information that iscontained in the three dimensions of the package being viewed. Anotheraspect allows the information to be used within other programs, e.g.,Powerpoint, or an executable file.

A graduated view system which displays different amounts of informationwhile loading additional information. The system starts by displaying atwo-dimensional image, or “splash”. The two-dimensional image itself isformed in a graduated manner, using a low resolution image, which isprogressively increased in resolution as more information is received.The two dimensional image is shown while the three-dimensional imageinformation is loading.

The final image can also be graduated. It can include lower resolutionportions which show the ornamental portions of the object, andhigher-resolution portions which show the readable portions of theobject. In one embodiment, the higher-resolution portions are formedfrom ASCII text.

According to another aspect, an HTML extension is defined which enablesthe three dimensional viewing.

Another aspect defines a reduced data set for the system described abovewhich enables separate views from different angles to simulate threedimensional viewing without actually using a continuous threedimensional view.

Another aspect teaches a new paradigm for selling products in which theproducts are exhibited on the Internet using information that isobtained from a three-dimensional view of the product that includes atleast enough resolution to read each of a plurality of labels of theproduct, and to see the shape of the product from each of a plurality ofdifferent views. Another part of the paradigm has the seller of theproduct providing electronic images representing packaging informationfor the product. The web sites that sell the product can use thatpackaging information as parts of their website. Like stores, whereevery store gets a package for the product from the vendor, eachInternet seller gets an electronic package for their product from thevendor.

The preferred embodiment will be described with reference to FIG. 1which shows an exemplary web page using the present system. While thepreferred embodiment describes this system being used on the Internet,it should be understood that this can be used on any remote informationserver that is used to sell products.

The product shown in this embodiment is a bottle of aspirin. The bottleof aspirin has a specified three-dimensional shape. The manufacturer ofthe aspirin produces the bottle and the packaging for the product. Inthis embodiment, the manufacturer also provides two different files, onebeing a progressively renderable two-dimensional JPEG image of thebottle as seen from the front. Another image is a three-dimensionalrendering of the bottle. Such information can be produced usingthree-dimensional AUTOCAD™, or some other three-dimensional drawingprogram. The three dimensional rendering that is produced has at leastsufficient resolution to enable reading all of the labels on theproduct. In FIG. 1A, a screen shown at an initial time is shown. Anormal sales screen 100 includes the general description of the product,the price, and ability to “add to cart” and “Check out”. FIG. 1A alsoshows a image portion 110.

The whole page—image portion 110 and the sales screen 100, are definedat step 200. The sales screen is defined using HTML code. The imageportion is defined within the HTML code also and this can be displayedas a rectangle as shown in FIG. 1A.

FIG. 1A shows a progressively-rendered two dimensional JPEG beingdisplayed as 112. This is shown in the FIG. 2 flowchart. At step 202,the display of the progressively rendered JPEG begins. First the lowestresolution version is displayed at step 202. After the lowest resolutionversion is on the screen, the 3D image begins loading at step 204, andat the same time more information about the two-dimensional JPEG isloaded at 206. The JPEG resolution is increased by the additionalinformation.

When the 3D image is completely loaded, a new image portion 110 isdisplayed at 208 that shows the information in the 3D image.

FIG. 1B shows this image portion including a simulated three-dimensionalview of the product 122. A plurality of movement keys 123-130 definedifferent movement directions. Each enables rotating the view of theproduct in the direction defined by the arrow of the key. FIG. 1B showsthe front view. By manipulating the movement keys, the rear of theproduct 122 can be viewed. FIG. 1C shows the rear view.

Both of these views have sufficient size and resolution to allow thelabels to be clearly visible and preferably large enough to be read. Theuser can also rotate the view to obtain different views—a side view, anedge view, and views of different labels.

The user can also actuate the zoom-in button 136 to zoom-in on a portionof the product. The zoom can be centered on the readable label so thatthe user can obtain a larger picture of the label to read theinformation from that picture. FIG. 1C shows a slightly zoomed-inversion.

Another aspect uses graded resolution for the image. The ornamental partof the packaging can be displayed with different resolution than thereadable parts, e.g., the labels. In one embodiment, the actual productis formed of different zones as shown in FIG. 1D.

Each zone has a different kind of information, e.g., a highly compressedJPEG image portion 180 for the ornamental part, a less compressed JPEGportion 182 for more important parts, and finer resolution parts 184.The fine resolution part 184 can be ASCII or rich text format typetextual information.

It should be appreciated from the above that the user can look at theproduct from any desired angle. The user can read all of the labels onthe product, and can see packaging from different angles. In the case ofa boxed product, the user can see the box from all different anglesincluding front, back, top and sides. Another movement key can enablethe user virtual opening of the box to see the product inside.

According to a preferred mode of carrying out this system, the entirethree-dimensional image loads until it is completely loaded, and then itis displayed. The three-dimensional image is preferably compressed usinglossy compression to minimize the size of the image.

In an alternative mode, only the view being called for is loaded. Theremainder of the portions of the three-dimensional views are loaded inthe background, or only loaded when requested.

Another embodiment of this system defines an extension to hypertext markup language which simulates the three-dimensional representation of theproduct/packaging using a reduced data set. The true 3D image storesreal 3D information that can be manipulated to see the object from anyangle or view. In this HTML extension, in contrast, it is recognizedthat most objects can be looked at as being like a cube. The cube can beviewed from points 1-6 shown in FIG. 3A—front, back; top, bottom; left,right.

Additional vantage points may be desirable to allow viewing from angles.20 additional points are shown in FIG. 3B. Therefore, 26 discrete imagesprovides all the basic views that could simulate a three-dimensionalview of the product.

A reduced data set view can be formed from only the six basic views inFIG. 3A, viewing the object from only the points 1 through 6 shown inFIG. 3A. An even further reduced data set can view the object only fromfront and back views without allowing viewing front, back, top andbottom.

Other combinations of these sets are also possible.

According to this system, the product is first displayed from a defaultview in the product screen 100. The default view is one in which thefront of the product, for example, is viewed. The image for each of theviews is lossy-compressed using JPEG or MPEG compression. This defaultimage loads first, as shown in step 350 in FIG. 3C. After the defaultimage is loaded, the other n images, e.g. 21 other images, begin loadingin the background. The HTML extension also displays arrow keys whichenable rotation of the image and viewing the image from other vantagepoints. Depending on the number of images, each actuation of the arrowkeys will select a different amount of rotation. The rotation is inactuality effected by displaying a different image.

The arrows are detected in step 352, and used to select a differentimage. The next image is loaded. For example, if the default view isloaded (front in FIG. 3A), then an arrow to the left selects view 17 inFIG. 3B. An arrow left/down (arrow 123 in FIG. 1B) selects view 5 inFIG. 3B. Each arrow operation can be used in conjunction with the map ofviews to select the next view for viewing.

This HTML code can be executed by loading the first JPEG and loading theremainder in the background, or can load the views only when requested.

This system allows the web site operator to select the amount ofinformation they want to present. The amount of change from the arrowsdepends on the number of images that have been loaded. A reduced dataset can be provided, or more information to show more about the productpackaging. The smallest data set that contemplated is n=2 which wouldshow the front and the back of the product. As in the other embodiments,preferably enough information is provided such that each of the labelson the product can be read, either directly, or using the zoom function.A particularly preferred form of compression uses an adaptable lossycompression where parts of the product are compressed with a firstcompression ratio, and the parts containing the label are stored in adifferent way. For example, the label could have more resolution, or bestored in text form.

The concept of touch and feel is quite prevalent in a bookstore. Manybookstores are common on the web, such as BarnesandNoble.com andAmazon.com. These provide very convenient browsing for an individual whoknows what book they want to buy. The individual can often see a pictureof the cover of the book, and read certain reviews about the book.However, the amount of data is often limited. Moreover, the data that isput on the website is typically data that is decided by the websitedesigners, rather than the publishers of the book. The present paradigmallows those who package the book to decide what the book should looklike, and what a buyer should see when they are thinking about buyingthe book.

In bookstores, readers can often sit and look at the books or even readfrom parts of the books. A user with enough determination can sit andread a whole book. Bookstores operate based on the assumption that mostpeople will not read all books in that way. However, it enhances theexperience of the bookstore. It allows the user to decide if they likethe book or not.

The present embodiment teaches a remote information server salesparadigm, which starts by obtaining a digital image of at least parts ofthe book. Those digital images could be supplied by the publisher ordesigner and then used to provide information on the book to peoplereading the book. This allows the user to read parts of the book.

A problem would exist, however, if the entire book was freely available.In that case, any user could download the whole book and then read it ontheir computer at their leisure. Accordingly, the present system teacheslimits on the amount of reading that can be done. A limit is definedthat limits the amount of reading that can be done. The amount ofreading is stored in a file indicating the user's activity, e.g., a“cookie”. The cookie can expire or persist, as described herein. Thecookie can be stored on the information server, or on the user's homecomputer. If the cookie expires, then additional reading can be donelater. Another embodiment defines total limits, where the user islimited in the amount that they can read any title, and the cookie doesnot expire.

The present system also facilitates touch and feel like in the firstembodiment. However, the touch and feel is modified for use in reading abook. A reader of a book looking at the exterior of the book needs onlyto see the front cover, back cover and spine. There is no need to seethe top, bottom or other edges that do not typically contain viewedinformation. In addition, certain information is often printed oninsides of the covers, on, for example, the liner notes. The book isvirtually openable to read those inside portions. According to thisembodiment, at least the covers, the liner notes andbiographic/informational notes, and the table of contents, if any areprovided as digital images.

A front view of the book as displayed on the web browser is shown inFIG. 4A. The view includes the front cover of the book showing anaccurate depiction of the look of the book including the title, andartwork. The view has a resolution that is sufficient to enable theprinting on the book to be read by a viewer. A number of additionalmanipulation keys are also defined to change the view of the book thatis seen by a viewer.

A first manipulation key 402 defines turning over the book. When thecursor is placed over this key for about 2 seconds, a small text item, a“screen tip”, is displayed indicating “turn the book over”. If that keyis depressed, the view changes to the view shown in FIG. 4B which showsthe book from the back. Again, the colors and artwork of the book areaccurately depicted. The printed portion of the book is displayed in amanner enabling that printed portion to be accurately read. As in theprevious embodiments, this can use a graded resolution system, thatprovides more resolution for the readable parts of the book than isprovided for the ornamental parts of the book.

An “open the book” indicia is also shown as element 506 in both thefront and rear views shown in FIGS. 4A and 4B respectively. When theopen book is actuated, the book is virtually opened. Clicking the openin FIG. 4A yields the screen shown in FIG. 4C which shows the first twoprinted pages of the book. A “zoom” function changes the operation toshow only a single printed page, with enhanced detail. Clicking the openin FIG. 4B yields an analogous operation of opening from the rear of thebook, exactly as the book would be opened if it were placed from therear. This operation is not shown, but would yield the last two pages ofthe book. The front pages and rear pages of the book often include linernotes about the book, general information about the book or its author,pictures, and the like. One or more than one page of this informationcan be provided.

Two indicia 422 and 424 are also displayed respectively representingpage forward and page backward. The page forward advances the open pageby one sheet, much as it would look if the page were turned on a book.In the dual page display of FIG. 4C, this would be like paging forwardin the book, to show two new pages. Page back 424 goes back by onesheet.

Note that the move keys are always shown as arrow keys. These keyschange meaning based on context, but always mean that movement in somedirection will be carried out.

Each open page enables reading the entire amount of print on the page.There may be no limit set for retrieval of certain pages such as linernotes, pictures and biographies, table of contents and indices. However,for actual text, some predefined limit on total new page requests can bedefined. The user is allowed to read, for example, 20 pages out of theentire book. Each time a page that has a certain data type loads, itexecutes the flowchart of FIG. 5. A next page operation at 500 firstdetects if a new page is being requested, at 502. If so, a count isincremented at 504. When the counter reaches a specified value detectedat 506, e.g. 20 times, further requests are prohibited. The counter canbe present in a cookie, and the cookie can be reset, for example, each24 hour period. This enables the user to come back a day later and lookat other pages in the same book. If the limit is not exceeded, then thepage is fetched at 508.

Just like being in a real bookstore—with enough patience and ingenuity,the entire book can be read. However, at any one sitting, the user canselect a certain number of pages to read. For instance, the limit canalso be set to only allow certain pages to be read, such as the firstchapter only.

Right clicking on any of the images brings up a context menu whichenables the different possible operation, e.g., close the book, a go-todialog enabling changing to a specified page in the book and othernavigation items.

Another modification describes allowing the limits on the book readingto be lifted by payment of a fee. In this embodiment, a fee, e.g. a bookreading fee, could be charged for allowing the user to read the entirebook. After paying this fee, the user gets unrestricted access to thewhole book. The user can read the whole book in one or many sessions.The cookie can also store a bookmark, so that the user can return totheir computer during a later session, and take up reading where theyleft off.

This embodiment has described reading books. However, these techniquescan also be used for any other system in which the merchandise can beread. This can be used with music such as Cds, videos, etc. In thosecases, the entire stored information can be the inside and outside ofthe covers, and the liner notes that go along with the music, e.g.,length of songs, band members, song lyrics, etc.

Other embodiments are within the disclosed modes. For example, thepresent application is described as being used with HTML over theInternet. However, it could be used with any remote information server,using any programming language. For example, this could be used over amodem or other information line that is dialed up or connectedpoint-to-point. The screens described herein could be compiled into, forexample, an executable file that is downloaded with an instruction toexecute upon receipt. Then, the file is executed to allow viewing themerchandise. The limits described herein in the “book reading”embodiment could be compiled as part of the code. Also, like in theembodiment, the whole book could be downloaded, and only part of itavailable for viewing. The rest would be viewable only after paying afee. The rest could be, for example, encrypted, and the user is giventhe decryption code after paying the fee.

The embodiment has described images being used to represent the items.However, it should be understood that other forms are possible.

1. A method, comprising: providing an electronic version of a book;enabling a prospective purchaser to read only a portion of the bookprior to purchase of the book; displaying to a user, a book reading fee,that is charged for allowing the user to read the entire book; andallowing the user to read the whole book only after obtaining said bookreading fee from said user.
 2. A method as in claim 1, wherein the bookcan be read in multiple sessions after paying said book reading fee. 3.A method as in claim 1, wherein said allowing comprises allowing theuser to download the book after paying said book reading fee.
 4. Amethod as in claim 1, further comprising providing a bookmark functionwhich marks a location of reading and enables navigating back to saidlocation of reading at a later time.
 5. A method as in claim 1, furthercomprising enabling navigation to a specified page in the book.
 6. Amethod comprising: allowing the user to read only a portion of a bookelectronically on a electronic book reading computer; accepting a feefrom the user to read the entire book electronically on the electronicbook reading computer; and responsive to said accepting said fee,allowing the user to read the entire book electronically, wherein saidallowing comprises allowing the user to read only a portion of the bookelectronically.
 7. A method as in claim 6, further comprising enablingdownload of the electronic book.
 8. A method as in claim 7, wherein theelectronic book is encrypted.
 9. A method as in claim 8, furthercomprising, responsive to said accepting a fee, decrypting saidelectronic book to allow it to be read.
 10. A method as in claim 7,wherein said download is enabled only after paying said fee.
 11. Amethod as in claim 6, further comprising a bookmark function, whichallows marking a last-place of reading.
 12. A method as in claim 6,further comprising a navigation function that allows navigation to aspecified page in the book.
 13. A method, comprising: providing a lockedelectronic copy of a book to a user, which lock electronic copy can beviewed on a book reading computer, but which when provided, is lockedagainst reading and cannot be read on said book reading computer;accepting a fee from a user to read the entire book electronically; andresponsive to said accepting a fee, unlocking said electronic copy. 14.A method as in claim 13, wherein said locked electronic copy isencrypted, and responsive to said accepting said fee, providing adecryption code that allows reading the book.
 15. A method as in claim13, further comprising responsive to accepting said fee, providing acode to the user that allows the electronic copy to be read.
 16. Amethod as in claim 15, wherein said providing comprises enablingdownload of the electronic copy of the book.
 17. A method as in claim 16wherein said providing a code comprises providing a decryption code.